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Abstract: Although much research has examined 
students’readiness levels as they prepare to transi¬ 
tion from high school to college, little published 
research exists on the specific literacy expectations 
students will face in their early college experiences. 
This article provides an overview of a model for 
determining the reading demands and expectations 
in such early-college courses. The evaluative model 
allows faculty teams to examine the academic 
literacy expectationsfor introductory-level general 
education and career technical courses and simul¬ 
taneously explore the curricula in developmental 
reading courses. Using the model, evaluators can 
determine the degree of alignment of text difficulty 
levels, expectationsfor student literacy competen¬ 
cies, and standard literacy practices within and 
across courses. 

The college and career readiness movement and 
P-20 pipeline reform efforts have been, in part, 
catalysts for the development and adoption of the 
Common Core State Standards (CCSS). Major 
goals of the CCSS have been clarifying standards 
beginning with what is considered college and 
career ready and systematically backward-bench- 
marking each educational grade level down the 
ladder through kindergarten (Common Core State 
Standards, 2010). Of significant concern through¬ 
out the language of the standards are academic 
literacy development and proficiency, with a goal 
of having students exit high school ready for lit¬ 
eracy expectations of the workplace or placement 
directly into college-level courses. Of course, hav¬ 
ing students college-text ready upon exit from high 
school is-and should be-a focal goal; however, it is 
important to realize that the field has encountered 
a number of similar literacy movements over the 
years that have had only moderate success (e.g., 
Right to Read, Goals 2000, No Child Left Behind). 

Indeed, at present, increasing numbers of 
first-year college students are being placed into 
one or more developmental reading courses prior 
to beginning their college-level courses (Boatman 
& Long, 2010; Hughes & Scott-Clayton, 2011; 
Quint, Jaggars, Byndloss, & Magazinnik, 2013). 
Further, it will be at least a decade before students 


who have had full benefit of the CCSS or other 
reform-oriented curricula based on the college/ 
career-ready philosophy will enter either the 
workforce or higher education. In the meantime, 
there will continue to be nontraditional students 
returning for postsecondary training and educa¬ 
tion. For these reasons, professionals associated 
with developmental reading will continue to be 
called upon to provide assistance in transitioning 
students to the rigors of postsecondary academic 
literacy practices. Therefore, as changes in PK-12 
emerge in response to educational reform efforts, 
it is critical that experts within the field of college 
reading actively engage in college-readiness con¬ 
versations for purposes of informing developmen¬ 
tal reading curriculum and instruction. Equally 
important is that college reading professionals 
engage in research on and evaluation of post- 
secondary literacy practices and expectations in 
order to ensure that college-readiness, alignment- 
focused dialogues are reciprocal in nature. 

Examining Key Educational 
Transition Spaces 

The college and career readiness movement in the 
United States has prompted some significant shifts 
in research foci. One other reform movement has 
emerged that parallels the college and career readi¬ 
ness movement but focuses more specifically on 
degree and certificate attainment (or, more gener¬ 
ally, graduation) in higher education. This latter 
movement has prompted calls for an increase in 
earned postsecondary credentials. In short, these 
educational reform movements have prompted 
a critical examination of some key educational 
transition spaces. For instance, the college and 
career readiness movement has been a catalyst for 
investigating the transition space between PK-12 
education and college. As a result, research centers 
and nonprofit organizations across thecountry have 
begun to examine the issue of college readiness 
(Barnett et aL, 2012; Conley, Drummond, Gonzalez, 
Rooseboom, & Stout, 2011; Sepanik, 2012). Scholars 
in these areas of policy and scholarship are care¬ 
fully examining readiness levels of students as they 
prepare to transition from high school to college. 
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Similarly, the higher education attainment 
movement has urged newinterest in the transition 
space between beginning college and graduation 
(Adelman, Ewell, Gaston, & Schneider, 2010; 
Complete College America, 2011; Scrivener & 
Coghlan, 2011). Indeed, recent research has 
focused on the experiences of students transi¬ 
tioning from developmental education toward 
college completion (e.g., Maggs, 2011). Also, the 
National Center on Education and the Economy 
(NCEE) has recently released a report (2013) on 
what it means to be college-ready in English/ 
literacy and math in community college settings. 
However, college reading experts have thus far not 
been particularly active in publishing reports of 
research on students’ specific academic literacy 
needs in their developmental education and intro¬ 
ductory-level general education/career technical 
education (GE/CTE) courses. It should be noted 
that research focusing on the literacy demands of 
higher education has been conducted previously 
(e.g., Burrell, Tao, Simpson, & Mendez-Berrueta, 
1997; Chase, Gibson, & Carson, 1994; Orlando, 
Caverly, Swetnam, & Flippo, 1989; Stahl, 1982). 
However, previous and current research do not 
provide a curriculum audit model that might be 
adopted by faculty for determining whether, how, 
and to what extent current developmental reading 
programming aligns with GE/CTE coursework. 

Informing Developmental Reading 
Programming 

Developmental education programs—under a vari¬ 
ety of labels—have been an integral part of higher 
education since the middle 1800s, and, despite cur¬ 
rent reform efforts (e.g., Complete College America 
2011, 2012), they are likely to be continued on the 
college reading and learning front well into the 
future (Brothen & Wambach, 2012). Indeed, with the 
changing requirements ofthe job market, even more 
individuals will require a postsecondary education of 
some sort, suggesting the continued need for literacy 
instruction at the college level well into the future 
(Pimentel, 2013; Stein, 2001). Furthermore, when¬ 
ever a new set of rigorous standards is implemented 
in education, there is every expectation that there 
will be a new set of students falling into an “at-risk” 
or “remedial” classification. 

One way that professionals in the field of devel¬ 
opmental education can move ahead to improve 
this programming is by continuing the alignment 
work that is being initiated elsewhere in the educa¬ 
tional system (i.e., CCSS, 2010). Specific to develop¬ 
mental reading, the field’s collective energy needs 
to be directed toward establishing comprehensive 
college reading programs, especially programs that 
shift the focus from “remediation” to authentic 
preparation for postsecondary success (Paulson 
& Armstrong, 2010). Such programmatic reform 


efforts begin with having a conception of college 
reading readiness at the local institutional level. 

This understanding of the local context 
is precisely what the senior administration at 
Southside Community College wished to ascertain. 
Specifically, they wanted to learn about how the 
reading instruction—including text expectations 
and goals—within the existing developmental 
reading courses aligned with the text expectations 
and goals for introductory-level GE/CTE courses. 
Therefore, an investigation was designed to exam¬ 
ine the academic literacy expectations for both the 
developmental reading and the GE/CTE courses. 
Because this project involved experts from outside 
the institution gathering information about exist¬ 
ing programming in order to evaluate its efficacy, 
we adopted English’s (1988) terminology in calling 
it a “curriculum audit.” This curriculum auditwas 
intentionally designed todetermine the alignment 
of skills, competencies, and faculty and student 
expectations at the local level across the representa¬ 
tive target courses. The purpose of this article is 

Programmatic reform 
efforts begin with having 
a conception of college 
reading readiness at the local 
institutional level. 


to provide an introduction to and overview of the 
development of the curriculum audit model that 
was employed so that other programs might adopt 
or adapt similar procedures to ascertain the reading 
expectations in courses at other institutions. 

Audit Context 

Southside Community College (SCC), locatedjust 
outside a major metropolitan area in the Midwest, 
served 31,401 students in 2010. Twenty-nine per¬ 
cent of freshman sections offered by the English 
Department in 2010 were developmental reading 
course sections. Of the fulltime entering fresh¬ 
men, 37.8% placed into developmental reading 
courses, as determined by scores achieved on the 
ACT-COMPASS placement assessment. For SCC 
students placing into three developmental-level 
subjects (reading, writing, and mathematics), only 
6% completed a certificate and none earned an 
associate degree within 3 years. The administra¬ 
tion of the college desired to address this troubling 
trend by assessingthe efficacy ofthe developmental 
education programming and, in particular, the 
reading curriculum. Still they understood that, 
first and foremost before a corrective plan could 
be implemented, the question “what are the local 
constructs and demands of college reading in the 


disciplines comprising the introductory general 
education and career technical education courses” 
had to be answered. The administration, therefore, 
sought out a team of researchers in the field of 
postsecondary literacy to design an investigation 
of the current state of reading instruction at SCC 
and carry out the resulting curriculum audit. 

Theoretical Perspective on the 
Development ofthe Model 

The development of this model has been driven 
by a view of literacy that is informed by sociolin- 
guistic and sociocultural theories (Barton, 2000; 
Gee, 1996; Heath, 1983/1996; Langer, 1992; Street, 
1999). From this perspective, academic literacy 
practices are complex, dynamic social practices 
that are situated and dependent upon disciplinary 
values, models, and norms, as well as learner sche¬ 
mata. Thus, literacy practices must be investigated 
in context. Also informed by recent scholarship on 
disciplinary literacy pedagogy, a key assumption 
underlying this model is that the context-specific 
nature of academic literacies is generally not 
explicitly taught, either in high schools or in col¬ 
leges (Shanahan & Shanahan, 2008). Therefore, 
one’s perspective needs to be informed by explicit 
modeling and apprenticing for learners new to aca¬ 
demic literacy practices in the community college, 
whether they are placed into developmental read¬ 
ing courses or directly into GE/CTE coursework 
(c.f., Bartholomae, 1985). If the theoretical goal of 
developmental reading instruction is to provide 
access to higher education, and specifically to 
academic modes of literacy, then developmental 
reading courses must be informed by and aligned 
to the actual literacy practices expected of students 
in their future courses (c.f., Simpson, 1996). Hence, 
we have developed an audit model that examines 
literacy practices in a variety of disciplines and 
fields and looks at alignment across levels. 

Audit Methods 

The curriculum audit model described in this 
article focuses on literacy practices primarily 
considered to fall under the purview of reading 
instruction. The audit was driven by the following 
overarching questions; 

1. What constitutes college-level text-readiness 
at Southside Community College (SCC)? 

2. What are the text expectations, including 
text types, tasks, and goals in developmental 
reading courses, in general education courses, 
and in career technical education courses? 

3. How do these text expectations align? 

4. What is the culture of reading at SCC? 

Although these guiding questions were rather 
broad in scope, the audit was intended to provide 
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insights about the overall state of reading instruc¬ 
tion and expectations at this institution. Thus a 
protocol was designed to incorporate both quali¬ 
tative and quantitative data sources and analytic 
approaches. The design reflects the need to gather 
information from a large number of faculty and 
students (via a web-based survey instrument) as 
well as more in-depth information from smaller 
samples (i.e., focus groups). 

Data Collection Overview 

The purpose of this article is not to provide a 
detailed report of procedures or findings. However, 
an overview of the data collection and analysis 
approaches used is needed to provide an overall 
sense of the various aspects of the audit model. We 
undertook this audit over the course of 2 years, 
with the bulk of the data collection occurring in 
a single semester. The audit included a systematic 
protocol consisting of three foci. 

The first focus, on GE/CTE courses, provided 
information on what constituted text-readiness 
both at the disciplinary level and, to a degree, at the 
institutional level. Here the goal was to determine 
the implicit or explicit local definition of college 
text-readiness by surveying, interviewing, and 
holding focus groups with faculty members across 
the college who teach introductory-level GE/CTE 
courses. In addition, we gathered course materi¬ 
als from representative courses (e.g., course texts, 
syllabi, lecture notes, instructor PowerPoints), and 
observed targeted class sessions to gather data 
on in-class text usage, textbook-reading strat¬ 
egy instruction, and discipline-specific literacy 
instruction. 

Simultaneously, we employed the same 
data-gathering protocol with a second focus on 
the developmental reading courses at SCC. Just 
as with the GE/CTE audit, we gathered data from 
faculty members teaching various levels and types 
of precollege-level reading and literacy courses, 
course and program-level curricular materials, 
and classroom observations. 

The third component focused on the voices 
of students. Through an online survey, interviews, 
and focus groups, we gathered data on student 
perceptions of institutional literacy expectations, 
college-text readiness needs, current developmen¬ 
tal reading preparation, and specific gaps in their 
own literacy transitions. 

Instrumentation 

The instruments employed in this audit included 
a classroom observation checklist, a faculty 
focus-group questionnaire, a student focus-group 
questionnaire, an online faculty survey, an online 
student survey, and a series of text analyses. Each 
instrument is described following. 

Text-readiness classroom observation 
checklist. The classroom observation checklist 


instrument designed for this audit was intended 
to allow the auditors to gather information on 
whether course texts were being referenced, the 
content explained, or the text incorporated dur¬ 
ing a typical class session. Development of similar 
observation instruments has been detailed in prior 
research investigating the literacy environments of 
elementary classrooms (Hoffman, Sailors, Duffy, 
& Beretvas, 2004; Smith, Dickinson, Sangeorge, 
& Anastasopoulos, 2002; Wolfersburger, Reutzel, 
Sudweeks, & Fawson, 2004). Although classroom 
observations have been a key methodological 
approach previously (i.e., Grubb, 1999, 2012), far 
less research has focused on the development of 
instruments for assessing the literacy environ¬ 
ments of postsecondary classrooms. 

Using the instrument with the targeted course 
sessions, the auditors recorded the absolute use 
(yes or no) as well as the frequency of use of 11 
instructor text-usage references (as well as student 
usage). These references included observation notes 
such as whether the instructor’s copy of the text 

Students who had taken 
developmental reading 
courses were also asked 
about their perceptions of the 
preparation they received. 


was visible, displayed for students, and directly 
referenced; whether text organization or structure 
was mentioned, explained, or supportedby a strat¬ 
egy for navigating; whether the class discussions 
and homework appeared to be text based or text 
driven; and whether multiple texts or multimodal 
texts were incorporated in the course readings. 

The checklist instrument allowed for an 
overall tally of whether these text-based activi¬ 
ties occurred within the classroom context and, 
if so, who initiated them (instructor or students) 
and how frequently they occurred. Beyond this 
tally, the instrument provided space for comments 
for each item as well as any relevant observations 
of text-based activities beyond those listed in the 
instrument. 

Faculty focus-group questionnaire. In 

order to identify the explicit and tacit academic 
literacy expectations of faculty teaching the GE/ 
CTE and developmental reading courses at SCC, 
semistructured group interviews of 45 to 60 
minutes each were included in the data-gathering 
protocol. Similar to previous focus-group research 
(Brockman, Taylor, Kreth, & Crawford, 2011), each 
of the focus-group sessions in this study grouped 
faculty from similar disciplines, departments, 
status (full-time/part-time), and typical course 


type taught (developmental/credit-bearing). In 
order to allowfor an overall replicable structure for 
these focus groups across disciplines, the auditors 
developed a list of 11 guiding discussion questions. 
These questions aimed at gathering information on 
specific text expectations and text-based activities 
in courses at SCC. Also, faculty were questioned 
about their perceptions of students’ attitudes 
toward reading, reading habits and practices, and 
specific strengths and weaknesses related to aca¬ 
demic literacy. Another inquiry topic for the focus 
groups emphasized the extent to which explicit 
instruction was being provided on the associated 
and expected discipline-specific literacy practices. 
Finally, questions were posed regarding the efficacy 
of the existing developmental reading curricula in 
preparing students for next-level courses. 

Student focus-group questionnaire. Just as 
with the faculty focus groups, the student focus 
groups used a semistructured conversational inter- 
viewapproach.Accordingto Billups (2012), specific 
methods for conducting focus groups with college 
students have not been detailed. However, as part 
of prior research from a range of disciplines associ¬ 
ated with higher education, focus groups have been 
used as a way of getting feedback from students 
(e.g., Barbatis, 2010; Frailey, Buck-Rodriguez, & 
Anders, 2009). 

As the basis for the 45 to 60 minute focus- 
group sessions, the auditors developed a list of 
11 guiding discussion topics. In order to dovetail 
with the information gathered from the faculty 
focus groups, the student focus groups allowed 
a space for gathering similar information about 
the amount, frequency, type, and tasks associated 
with their required course readings. Follow-up 
questions provided opportunity for participants to 
discuss how these actual text practices compared 
with their initial expectations as well as their previ¬ 
ous high school experiences, and whether and to 
what extent those experiences were effective in 
preparing them for the text expectations in their 
current courses. Further, students who had taken 
developmental reading courses were also asked 
about their perceptions of the preparation they 
received in those courses. 

Online faculty survey. We gathered survey 
data using an adaptation of Simpson’s “Academic 
Literacy Questionnaire” (see Simpson, 1996), 
which was formatted for online use through Survey 
Monkey. This survey gathered data on faculty 
demographics and prompted identification of a 
specific target GE/CTE or developmental read¬ 
ing course as the context for responding to the 
subsequent 23 survey questions. The latter items 
requested information on text usage, expectations, 
course assignments, assessment practices and the 
relationship to text assignments, course lectures 
and the relationship to text assignments, and 

CONTINUED ON PAGE 6 
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faculty perceptions of students’ reading abilities 
and associated attitudes on reading. 

Online student survey. We also gathered 
survey data from students online through Survey 
Monkey. Student surveys have been a staple in past 
research on reading demands on college students 
(e.g., Chase, Gibson, & Carson, 1994; Orlando, 
Caverly, Swetnam, & Flippo, 1989). Just as with 
the online faculty survey, we initially asked stu¬ 
dents to identify a specific target course as a lens 
for answering the remainder of the survey ques¬ 
tions. The bulk of the questions focusedon reading 
expectations within that target course, including 
amount and frequency of required reading, text 
type, and associated text-based tasks. As well, a 
group of questions prompted students to provide 
information on the instructional approach, to 
include the extent to which the instructor taught 
about text organization and structure and taught 
specific strategies that represented expert reading 
approaches within that discipline. 

Textbook analysis. Rather than using a single 
instrument for the textbook analysis piece of the 
audit, we applied several well-established measures 
to the textbooks gathered from the GE/CTE and 
developmental reading courses. Although some 
readability and content analyses of developmental 
reading textbooks havebeendone (Williams, 2013; 
Wood, 1997) and a few readability and content 
analyses of college-level textbooks have been done 
(Stahl, Brozo, & Simpson, 1987), comparative 
analyses of developmental reading and GE/CTE 
course textbooks have not. 

To begin, we conducted abasic genre analysis 
to determine the types of texts being used across 


different instructional areas and disciplines. Next, 
for each textbook, we identified and sampled four 
full-page selections at quarterly intervals through¬ 
out the book (i.e., first full page and one page at 
one-quarter, one-half, and three-quarters of the 
book’s length). 

Traditional readabilityindices. Following the 
genre analysis, using the text-readability scoring 
program available athttp://www.readability-score. 
com/, we ran the following standard and traditional 
readability indices for each sample: 

• Flesch-Kincaid Grade Level 

• Gunning-Fog Index 

• Coleman-Liau Index 

• SMOG Index 

• Automated Readability Index 

• Average Grade Level Estimate 

As indicated previously, all of these indices use 
character- or syllable-level, word-level, and sen¬ 
tence-level aspects (usually syllables per word and 

Comparative analyses of 
developmental reading and 
GE/CTE course textbooks 
have not [been done]. 

words per sentence) in a mathematical equation 
that provides a grade-equivalency estimate of a 
text’s readability. (Generally speaking, the assump¬ 
tion underlying these indices is that words with 
fewer syllables as well as sentences with fewer words 



are more readable, so a reader at a lower grade level 
would be able to comprehend.) It is understood 
that readability analyses are not without inherent 
faults (Benjamin, 2012; Goldman & Wiley, 2011). 
Nevertheless, these formulae are used by reading 
professionals across all educational levels. 

Lexile text measure analysis. As a second 
measure of readability, we analyzed each text 
sample through the Lexile Text Measure Analyzer 
available at http://www.lexile.com/analyzer/. 
Although Lexile text measures do differ from the 
traditional readability indices in that they do not 
correspond with a grade level estimate (for more 
information on the limitations of grade-equivalent 
scores, see Flippo & Schumm, 2009; McKenna & 
Stahl, 2009); Lexile text measures do examine syn¬ 
tactic and semantic text characteristics (for Lexile 
text measures, length of sentences and frequency 
of words are measured). For this reason, Lexile 
text measures are highly correlated with most 
traditional readability measures (Williamson, 
2008; Wright & Stone, 2004). Because Lexile text 
measures are increasingly adopted in the schol¬ 
arly literature, it was important to use Lexile text 
measures to establish a solid baseline of data for 
future additions to this research. 

Friendly TextEvalua tions. In addition to these 
quantitative measures of readability, a Friendly 
Text Evaluation (Dreher & Singer, 1989; Singer, 
1992) was completed independently for each text. 
A Friendly Text Evaluation examines a text’s fea¬ 
tures (i.e., organization, explication, conceptual 
density, metadiscourse, and instructional devices). 
The Friendly Text Evaluation was added to this 
audit to ensure that text content, structure, and 
style were being considered, as well as the more 
quantitative and linguistic 
aspects that are addressed 
in the readability indices. 

Data Analysis 
Overview 


Figure 7. Graphic representation of interactions and layers embedded in the audit model. 


Data analysis involved 
two separate phases: an 
individual analysis of all 
data from within each 
data source (phase 1) and 
a full data analysis that 
examined findings across 
all data sources (phase 2). 
Phase 1 of data analysis 
began with full transcrip¬ 
tion of all focus group and 
interview sessions, allowing 
for initial identification of 
patterns. Following this, 
the observation and focus 
group and interview data 

CONTINUED ON PAGE 8 
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were analyzed separately using standard quali¬ 
tative approaches, including open coding and 
the constant-comparative method (Glaser & 
Strauss, 1967). Analysis of the numerical survey 
data involved descriptive statistical analysis that 
provided frequency counts, response percentages, 
ranges, and means. For all texts, we undertook a 
multipronged text analysis, as described previously, 
to determine any potential gaps in readability and 
complexity between developmental reading and 
GE/CTE courses. Analysis within individual data 
sources was followedby triangulation between and 
across data sources in phase 2. 

During the phase 2 integrative analysis, all 
data, including the observations, focus-group 
transcripts, survey data, and texts, were analyzed 
together using the constant-comparative method 
and cross-case analysis (Merriam, 1998) to identify 
emerging themes and patterns. 

The Resulting 
Curriculum Audit Model 

By examining representative introductory-level 
courses across the broad instructional areas at 
SCC (GE/CTE and developmental reading), we 
were able to ascertain a fairly comprehensive view 


of the overall culture of reading at the local level 
and with the entry-level courses. As well, even 
within these instructional areas, we accounted 
for disciplinary differences in text expectations. 
And finally we examined these three areas from 
both faculty and student perspectives. The audit 
model allowed for a multipronged, multileveled, 
triangulated exploration of the text expectations 
at SCC across educational areas, disciplines, and 
stakeholders (see Figure 1, p. 6). 

We found multiple instances 
in which instructors seemed 
to have decreased.. 


Deliverables of the Audit Model 

This audit model of reading instruction and 
demands for the community college has the poten¬ 
tial to provide sufficient information to answer 
the types of audit questions listed previously. 
This article focuses on a general overview of the 
audit model rather than an in-depth explanation 
of the methods and results. However, in order to 
give a sense of the kinds of insights to be gleaned 


through application of such an audit model, the 
audit questions and a few key observations are 
included in Table 1. 

Related to the first audit question, a consistent 
definition of college-text ready does not exist at 
SCC. A majority of the GE/CTE faculty assume 
that students should be ready for college-level 
texts by being able to read their college-level text¬ 
books independently upon entry to their courses. 
However, there is another group of faculty who 
expects students to be able, upon entry, to master 
independently the specialized types of text prac¬ 
tices found in their respective discipline-driven 
courses upon entry. Class observations suggest 
that there does not appear to be much explicit 
discussion by the instructor of what is considered 
college-text ready in the introductory-level GE/ 
CTE courses. 

Responses to the second audit question reveal 
different text expectations for the developmental 
reading courses and the GE/CTE courses. For the 
developmental reading courses, two types of texts 
are predominant: workbook-style practice texts 
and novels. By contrast, expository texts are used 
in the GE/CTE courses, including field-specific 
textbooks and, in some disciplines such as history, 
primary and secondary sources as well. 


Table 1 

Information and Observations Available From the Audit Model 

Questions 

Data Sources 

Observations 

What constitutes college-level text- 
readiness at Southside Community 
College (SCC)? 

• faculty surveys 

• faculty focus groups 

• classroom observations 

• No consistent definition of college reading readiness exists. 

• Faculty expect students to be able to read text independently. 

• Faculty expect students to have an understanding of disciplinary 
literacy practices. 

What are the text expectations, 
including text types, tasks, and goals 
in developmental reading courses? 

• faculty surveys 

• student surveys 

• classroom observations 

• faculty focus groups 

• student focus groups 

• text analyses 

• Mostly workbook-style practice texts and novels (narrative texts) are 
used. 

• The text-associated tasks are generally geared toward comprehension 
checks. 

• The goal for text usage is providing practice with identifying main 
ideas, developing vocabulary, and reviewing strategy use on a 
primarily procedural level. 

What are the text-expectations, 
including text types, tasks, and goals 
in general education and career 
technical education courses? 

• faculty surveys 

• student surveys 

• classroom observations 

• faculty focus groups 

• student focus groups 

• text analyses 

• More expository texts are used, including field-specific textbooks. 

• The text-associated tasks are generally quizzes and tests. 

• The goal for text is to be used as a support or instructor supplement. 

• There is a heavy reliance on PowerPoints and other textbook 
replacements. 

How do these text-expectations 
align? 

• comparison and triangulation 
of data sources intended 
to answer the second audit 
question 

• The types and difficulty levels of texts used in the developmental 
reading courses are distinctly different from those being used in the 
introductory-level general/career technical education courses. 

What is the culture of reading at 

SCC? 

• comparison and triangulation 
of all data sources 

• There is wide variation in the extent to which instruction is text-based 
or text-supported. 
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In the developmental reading courses, the 
instructional purpose for students’ use of text was 
aimed at comprehension checks and discrete skills 
such as identifying main ideas, developing vocabu¬ 
lary, and reviewing strategy usage on a primarily 
procedural level (that is, reviewing the steps needed 
to do a particular strategy). By contrast, the goal 
for students’ use of text in the GE/CTE courses 
was as a support, and in a few cases a supplement, 
to the instructor for learning the course content. 
As well, in many cases, text alternatives, such as 
instructor lecture notes, PowerPoints, and outlines, 
were made available to students. In such situations, 
although the text was assigned, it may not have been 
read. On a related note, we found multiple instances 
in which instructors seemed to have decreased 
their text requirements (to a shorter text, to fewer 
texts, or to easier texts). 

The third audit question, regarding alignment 
of text expectations, identifies a definite variance; 
however, the existing variance may promote the 
already existing academic skills gap. There is a 
potential mismatch between what is thought to 
be required reading in GE/CTE classes and what 
text practices are actually enacted in developmen¬ 
tal reading classrooms. Also, there is an overall 
conceptual gap, which is partly communication 
based. Not only are content-area faculty unclear 
on the purpose, scope, and goals of the develop¬ 
mental reading courses, but so too are the students. 
Similarly, developmental reading instructors may 
not be communicating with content-area faculty 
so as to design a college reading curriculum with 
a clear sense of what students will be faced with 
in their introductory-level GE/CTE courses. 

Finally, the last audit question supports 
several observations about the culture of reading 
at SCC. One important observation is that the 
introductory-level GE/CTE faculty at SCC are 
incorporating texts in their curricula; however, 
the extent to which the instruction is text based 
or text supported varies widely. Primarily, in the 
GE/CTE courses, the focus of instruction is on the 
content, not the literacy practices (even in terms of 
disciplinary literacy practices). This focus indicates 
an expectation that students read at the literal/ 
factual level rather than at a deeper level of mean¬ 
ing. In addition, in some courses, the instructor’s 
notes and PowerPoints are so rich that assigned 
texts are deemed unnecessary by students. 

Findings From Model Development 

Based on our experiences in developing and 
employing this model, we have identified some 
strengths and weaknesses with the model, all of 
which we intend to consider further in moving 
forward (Table 2 provides a listing of all methods, 
as well as notes on the utility of each approach). 

First, one major strength of this audit is its 
multifaceted, multimeasure approach as it allows 


for a fuller, richer description of the culture of 
reading at a particular institution. We are aware 
that many institutions use traditional readability 
formulae to help faculty choose appropriately lev¬ 
eled texts. However, the use of such analysis in isola¬ 
tion does not account for disciplinary differences, 
varying expectations, and perceived and actual 
text uses and purposes, all of which are critical for 
examining scaffolding and alignment both forward 


The instructors notes and 
PowerPoints are so rich that 
assigned texts are deemed 
unnecessary by students. 

and backward. Indeed, there has been very little 
published work to date of how college-text ready 
is defined, including the institutional culture of 
reading, especially as informed by actual course 


curriculum. Thus a major strength of the audit 
model presented here is the integration of various 
approaches to get at triangulation and provide a 
thick description ofwhatliteracy demands students 
will actually encounter as they transition from 
developmental reading to their next-level courses. 

In terms of instrumentation, several improve¬ 
ments are already underway as a result of our initial 
model development. For one, the classroom observa¬ 
tion instrument provided information on various 
types of text-related instruction as it occurred in 
classrooms, including a frequency count on how 
many separate instances were observed. However, 
future iterations of this instrument may need to 
account for the amount of time devoted to each 
instructional activity type. (For an example of such 
an instrument for STEM fields, see Smith, Jones, 
Gilbert, & Wieman, 2013.) Finally, given our strong 
support of a multipronged analysis, especially with 
regard to the textbook analysis aspects, we have 
begun working with additional and alternative text- 
analysis tools such as CPIDR, a computer program 

CONTINUED ON PAGE 12 


Table 2 

Utility of Methods Used 

Method/Instrument or Procedure 

Notes on Utility 

Class Observations 

• Text-readiness classroom observation 
checklist 

• Observations, ideally, should be conducted multiple 
times over an academic term. 

• Observations should include notes on faculty usage 
as well as student usage within the observed class. 

• Observations are useful for comparisons of text 
usage across sections, courses, and disciplines/fields. 

Focus groups 

• Faculty focus-group questionnaire 

• Student focus-group questionnaire 

• Offer multiple faculty focus groups, even within a 
single department, to ensure all voices are heard. 

• Offer multiple opportunities for focus group 
sessions convenient for full-time and part-time 
faculty, as well as daytime and evening faculty. 

• Assemble multiple groupings of students, depending 
on whether and when they took developmental 
reading. 

• Offer multiple opportunities for focus group 
sessions convenient for full-time and part-time 
students, as well as daytime and evening students. 

Survey 

• Faculty survey 

• Student survey 

• Surveys should include brief demographic data 
requests to later identify full-time/part-time status, 
discipline/field affiliations, and other data. 

• Surveys should, for deeper insights, allow 
participants (faculty and student) to identify a focal 
course to frame their responses. 

Textbook analysis 

• Traditional readability indices 

• Lexile text measure analysis 

• Friendly Text Evaluations 

• A combination of readability, complexity, and 
friendliness measures are needed. 

• CPIDER, an idea-density measurement tool was 
also attempted; however, further work is needed on 
the inclusion of such tools (also Coh-Metrix) for 
triangulation purposes. 
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for measuring propositional idea density (Brown, 
Snodgrass, Kemper, Herman, & Covington, 2008), 
and Coh-Metrix, “a computational tool that measures 
cohesion and text difficulty at various levels of lan¬ 
guage, discourse, and conceptual analysis” (Crossley, 
Dufty, McCarthy, & McNamara, 2007, p. 1). 

Limitations 

Some limitations should be noted regarding the 
audit model. First, such a comprehensive audit 
is time consuming, and there are potential costs 
involved. Indeed, if a similar project were under¬ 
taken internally by faculty or staff teams, release 
time would almost certainly be needed in order to 
undertake a comprehensive audit. 

Implications for Practice 

The audit model has provided a framework and 
a clearly delineated data-collection and analysis 
protocol that may serve as an exemplar for other 
college programs looking to initiate similar audits 
of text readiness and alignment of curricular 
reading expectations. In addition to exploring 
the culture of reading at a given postsecondary 
institution, this auditmodel is intended to allowfor 
solution-oriented investigations that will uncover 
insights on whether and to what extent current col¬ 
lege reading programming needs to be adjusted for 
students who are not ready for college-level texts. 

This model helped us to present a fairly com¬ 
prehensive response to the overarching inquiry 
posed by SCC administration (and of interest to 
many institutions): What are the local constructs 
and demands of college reading in the disciplines 
comprising the introductory-level GE/CTE 
courses? As acknowledged by the SCC adminis¬ 
tration, it was far more productive and efficient to 
identify an audit team from outside the institution. 
Itbecame clear that faculty schedules (5-5 semester 
course loads) simply could not allow for release 
time to undertake such an intensive project. In 
addition, and as with any institution, local issues 
and relationships might have hindered this process 
had internal faculty been assigned to it; there was 
a sense of greater objectivity by an outside team. 

Also, although we collected data for develop¬ 
mental reading, GE, and CTE courses simultane¬ 
ously, a protocol that examines alignment between 
developmental reading and one course type (either 
GE or CTE) would allow a more in depth audit. 
This may entail an extensive audit of one discipline 
or program area per year. If the goal of the audit 
is a comprehensive understanding of the literacy 
demands across the institution, a deeper exami¬ 
nation of each unit will be of far more use in the 
long term. In particular, such examinations could 
proceed from reforming course- or program-level 
reading expectations and objectives to develop¬ 
ing appropriate corequisite delivery models that 


integrate college reading and learning strategies 
instruction into GE/CTE courses. 

In theory, this model could provide similar 
information through audits at other institutions, 
other educational levels (e.g., middle school or high 
school), or even in other phenomena of interest 
beyond reading (e.g., writing, math). Given the 
larger national context and emphasis on develop¬ 
mental education and higher education reform, 
it is clear that the most comprehensive audit of 
a single local context is a good starting point but 
certainly not an end goal. For that reason, we have 
begun identifying ways of expanding the model 
for a richer, fuller audit. 

Expansion of the Audit Model 

The next step in developing this model is expansion 
toward a second generation. Specifically, the model 
must look beyond introductory-level course and 
program-level text expectations by investigating 
the literacy practices required at the next levels. 
For instance, this work would entail including 

Local issues and 
relationships might have 
hindered this process 
had internal faculty been 
assigned to [the audit]. 

students who have completed certificates or degrees 
at the local institution, or who have transferred 
to four-year schools. In other words, targeted 
workplace and university audits may provide 
essential information for back-mapped alignments 
in the spirit of true college and career readiness, 
specific to literacy instruction. For instance, such 
an advanced audit might account for the impact 
of current practices on students who have moved 
into the workplace. Similarly, an audit of reading 
expectations and practices could examine forward 
alignment between, for example, community col¬ 
leges and universities or workplaces. As well, in 
order to identify gaps related to alignment across 
postsecondary literacy instruction, students who 
do not complete courses, sequences, programs, 
or degrees would also need to be accounted for in 
this expanded model. 

An expanded audit model could then inform 
further examination of the text expectations at 
feeder high schools and, ultimately, middle 
schools. In this way, the audit’s extensions might 
be modeled similar to the structure of district or 
regional college-readiness alliances or partner¬ 
ship programs, which are becoming increasingly 
popular as college and career readiness initiatives 
(Douglas & Schaid, 2010). 


This expanded model would provide a 
structure to allow research and evaluation teams 
from community colleges across the country to 
recreate and implement audits to inform their own 
programming needs. More importantly, such a 
structure would encourage a broader scope that 
considers educational transition spaces beyond the 
immediate local context, with a goal of inform¬ 
ing a comprehensive approach to appropriately 
scaffolded literacy instruction at all levels. Such a 
structure, too, would allowfor the development of 
cross-disciplinary, cross-institutional teams who 
could be trained to adapt this model for ongoing 
investigations aiming toward curricular redesign 
and alignment. 

Conclusion 

The current national emphases on issues of col¬ 
lege and career readiness and credentialing and 
completion have continued to shift scholarly 
attention. Similar issues are represented in past 
research and practical literature (e.g., Stahl, 1982; 
Burrell, Tao, Simpson, & Mendez-Berrueta, 1997; 
Chase, Gibson, & Carson, 1994; Orlando, Caverly, 
Swetnam, & Flippo, 1989), but the present urgency 
has prompted a need for renewed inquiry. Although 
literacy researchers have played a major role in the 
current reform efforts in the PK-12 educational 
levels, postsecondary literacy researchers and 
institutional evaluation teams must also be active 
in this work. Using the audit model described here, 
and expanding the model as suggested, will allow 
postsecondary experts to work toward providing 
a fuller picture of the process by which students 
become college-text ready. With this fuller view, 
informed curricular innovations canbe developed 
at multiple levels, including developmental reading 
courses. Only through such informed curricular 
development can students’ literacy learning be 
appropriately and effectively scaffolded as they tran¬ 
sition to academic literacy expectations in college. 
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